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® System for generating a texture mapped perspective view. 

@ A method and apparatus for providing a texture mapped perspective view for digital maP SY^e^^^^^ 
system includes apparatus for storing elevation data (10). apparatus for storing texture f 
sSTna a oroiected view volume (12) from the elevation data storing apparatus, apparatus for P^^cessmg (14) 
a?pa;2 for ^^^^^^^ plurality of planar polygons (16) and apparatus for rendering images, The Proc^^^^^^ 
Xa^s furthl^ ^or receiving the scanned projected view volume from the sc^^^^^^^ 

fmerSates Snten^L between the vertices of each polygon in a linear fash.on as m Qouraud shading. 
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- - " - The present invention is directed to a system for generating texture mapped perspective views for a 

digital map system according to the preamble of the independent claims. 

BACKGROUND OF THE INVENTION 

5 

Texture mapping is a computer graphics technique which comprises a process of overlaying aerial 
reconnaissance photographs onto computer generated three dimensional terrain images, it enhances the 
visual reality of raster scan images substantially while incurring a relatively small increase in computational 
expense. A frequent criticism of known computer-generated synthesized imagery has been directed to the 

70 extreme smoothness of the image. Prior art methods of generating images provide no texture, bumps, 
outcroppings, or natural abnormalities in the display of digital terrain elevation data (DTED). 

In general, texture mapping maps a multidimensional image to a multidimensional space. A texture may 
be thought of in the usual sense such as sandpaper, a plowed field, a roadbed; a lake, woodgrain and so 
forth or as the pattern of pixels (picture elements) on a sheet of paper or photographic film. The pixels may 

75 be arranged in a regular pattern such as a checkerboard or may exhibit high frequencies as in a detailed 
photograph of high resolution LandSat imagery. Texture may also be three dimensional in nature as in 
marble or woodgrain surfaces. For the purposes of the invention, texture mapping is defined to be the 
mapping of a texture onto a surface in three dimensional object space. As is illustrated schematically in 
Figure 1 , a texture space object T is mapped to a display screen by means of a perspective transformation. 

20 The implementation comprises two processes. The first process is geometric warping and the second 
process is filtering. Rgure 2 illustrates graphically the geometric warping process for applying texture onto a 
surface. This process applies the texture onto an object to be mapped analogously to a rubber sheet being 
stretched over a surface. In a digital map system application, the texture typically comprises an aerial 
reconnaissance photograph and the object mapped is the surface of the digital terrain data base as shown 

25 in Figure 2. After the geometric warping has been completed, the second process of filtering is performed. 
In the second process, the image is resampled on the screen grid. 

It is the object of the present invention to provide a texture mapped perspective view architecture which 
addresses the need for increased aircraft crew effectiveness, consequently reducing workload, in low 
altitude flight regimes characterized by the simultaneous requirement to avoid certain terrain and threats, 

30 thereby increasing crew situational awareness.This object is achieved by the characterizing features of the 
independent claims. Further advantageous embodiments of the inventive system may be taken from the 
sub-claims. 

Crew situational awareness has been increased to some degree through the addition of a perspective 
view map display to a plan view capability which already exists in digital map systems. See, for example, 

35 EP-A2-0 341 645. The present invention improves the digital map system capability by providing a means 
for overlaying aerial reconnaissance photographs over the computer generated three dimensional terrain 
image resulting In a one-to-one correspondence from the digital map image to the real world. In this way 
the invention provides visually realistic cues which augment the informational display of such a computer 
generated terrain image. Using these cues an aircraft crew can rapidly make a correlation between the 

■40 display and the real world. 

The architectural challenge presented by texture mapping is that of distributing the processing load to 
achieve high data throughput using parallel pipelines and then recombining the parallel pixel flow into a 
single memory module known as a frame buffer. The resulting contention for access to the frame buffer 
reduces the effective throughput of the pipelines in addition to requiring increased hardware and board 

45 space to implement the additional pipelines. The system of the invention addresses this challenge by 
effectively combining the low contention attributes of a single high speed pipeline with the increased 
processing throughput of parallel pipelines. 

SUMMARY OF THE INVENTION 

60 

A system for providing a texture mapped perspective view for digital map systems is provided. The 
invention comprises means for storing elevation data, means for storing texture data, means for scanning a 
projected view volume from the elevation data storing means, means for processing the projected view 
volume, means for generating a plurality of planar polygons and means for rendering images. The 
55 processing means further includes means for receiving the scanned projected view volume from the 
scanning means, transforming the scanned projected view volume from object space to screen space, and 
computing surface normals at each vertex of each polygon so as to modulate texture space pixel intensity. 
The generating means generates the plurality of planar polygons from the transformed vertices and supplies 
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them to the rendering means which then shades each of the planar polygons 

lie invention provides a technology capable of accomplishing a fully mtegrated d.grtal map d.splay 

^Tl^''^::lT^Le. Of the invention, the polygons are shaded by means of the rendering 
means assianinq one color across the surface of each polygon. ,^„eH;oe 
in yTanle; alternate embodiment of the invention, the rendering means interpolates the .ntens.t.es 
between the vertices of each polygon in a linear fashion as in Gcuraud shading. 

T invention provides a diglL map system including capabilities for perspective ^'ew. transparency, 
texture mapS. hidden line removal, and secondary visual effects such as depth cues and artifact (..e.. 

'"'re'lnveSSriurther provides the capability for displaying fon^ard looking infrared (FUR) data and 
radarretrilges overlaid onto a plan and perspective view digital map image by fusing .mages through 
combining or subtracting other sensor video signals with the digital map terrain display- ^ 

The invention finally provides a digital map system with an arbrtrary warping ^P^^^Hrty of one d^^^^ 
onto another data base which is accommodated by the perspective view texture mapping capability of the 

""otr objects, features and advantages of the invention will become apparent to t^l^- f;;^^^^^^^^^^^ 
through the drawings, description of the preferred embodiment and claims herein. In the drawings, like 
numerals refer to like elements. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fioure 1 shows the mapping of a textured object to a display screen by a perspective transformation 
FiguSlustrars graphically t'he geometric warping process of the invention for applying texture onto a 

Figure 3 illustrates the surface normal calculation as employed by f e 'nventior^ 

Figure 4 presents a functional block diagram of one embodmient of the invent^n ^rspective 

Figure 5 illustrates a top level block diagram of one embodiment of the texture mapped perspective 

30 '^"^ret^emS^^^^^^^^^^^ the frame bu«er configuration as employed by one embodiment of the ^ 
'"^^Pgures 7A. 7B and 7C illustrate three examples of display format shapes. 

Fiqure 8 graphs the density function for maximum pixel counts. hv the 

Fgure 9 is a block diagram of one embodiment of the geometry array processor as employed by the 

'"'^S'gu^es 10A. 10B. IOC and 10D illustrated the tagged architectural texture mapping as provided by the 

invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

transform equation as follows: 



45 
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where a point (X.Y.Z) in 3-space is represented by a four dimensional position vector [X Y Z H] in 

homogeneous coordinates. 
55 The 3x3 suthmatrix 
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accx)mplishes scaling, shearing, and rotation. The 1x3 row matrix [L M N] produces translation. 
The 3x2 colunan matrix 
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produces perspective transformation. The 1x1 scalar [S] produces overall scaling. 

20 The Cartesian cross-product needed for surface normal requires a square root. As shown in Figure 3, 
the surface normal shown is a vector AxB perpendicular to the plane formed by edges of a polygon as 
represented by vectors A and B. where A x B is the Cartesian cross-product of the two vectors. Normalizing 
the vector allows calculation for sun angle shading in a perfectly diffusing Lambertian surface. This is 
accomplished by taking the vector dot product of the surface normal vector with the sun position vector. 

25 The resulting angle is inversely proportional to the intensity of the pixel of the surface regardless of the 
viewing angle. This intensity is used to modulate the texture hue and intensity value. 
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where 

A = Ax2 + Ay2 + Az^ 
35 B = Bx2 + By2 + 822 

A terrain triangle TT is formed by connecting the endpoints of vectors A and B. from point Bx, By. Bz to 
point Ax. Ay. Az. 

Having described some of the fundamental basis for the invention, a description of the method of the 
invention will now be set out in more detail below. 

40 Referring rrow to Figure 4, a functional block diagram of one embodiment of the invention is shown. The 
invention functionally comprises a means for storing elevation data 10. a means for storing texture data 24. 
a means for scanning a projected view volume from the elevation data storing means 12. means for 
processing view volume 14 including means for receiving the scanned projected view volume from the 
scanning means 12, means for generating polygon fill addresses 16. means for calculating texture vertices 

45 addresses 18. means for generating texture memory addresses 20. means for filtering and interpolating 
pixels 26 and a full-frame memory 22. The processing means 14 further includes means for transforming 
the scanned projected view volume from object space to screen space and means for computing surface 
normals at each vertex of each polygon so as to calculate pixel intensity. 

The means for storing elevation data 10 may preferably be a cache memory having at least a 50 nsec 

50 access time to achieve 20 Hz bi-linear interpolation of a 512 x 512 pixel resolution screen. The cache 
memory further may advantageously include a 256 x 256 bit buffer segment with 2K bytes of shadow RAM 
used for the display list The cache memory may arbitrarily be reconfigured from 8 bits deep (data frame) 
to 64 bits (i.e.. comprising the sum of texture map data (24 bits) + DTED (16 bits) + aeronautical chart 
data (24 bits)). A buffer segment may start at any cache address and may be written horizontally or 

55 vertically. Means for storing texture data 24 may advantageously be a texture cache memory which is 
identical to the elevation cache memory except that it stores pixel information for warping onto the elevation 
data cache. 

Referring now to Figure 5, a top level block diagram of the texture mapped perspective view 
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architecture is showr,. The architecture implements the lur^tions as showr, in Figure 4 and the discussion 
Shall refer to functional blocks in Rgure 4 and corresponding elemen s m Rgure 5. In some 
^^s s^Tas iment 14, there is a one-toK,ne correspondence between the functional blocks in Figure 4 
S^the ^chSctural elements of Figure 6. In other cases, as explained hereinbelow. the funcfons depicted 
fn Fiate 4 arcarried out by a plurality of elements shown in Rgure 5. TT,e elements shown m Rgure 5 
romons^a the telre mapped perspective view system 300 of the invention include elevation cache 

44. video generator 46 and a plurality of data bases. 
GEOMETRY ENGINE 

The aeometry engine 36 Is comprised of one or more geometry array processors (6APs) which 
process the 4^? Ede matrix transformation from object space (sometimes referred to as >orid" sf«ce) 
to Seen space The GAPs generate X and Y values in screen coordinates and Zw values m range dePtfv 
^,e GAPS X cornpute surf ace normals at each vertex of a polygon representing an .mage ,n ob,ed space 
vTa Cartesian cross-products for Gouraud shading, or they may assign one surface '^^I'^^J^^ 
DolvSn frflat shading and wire mesh. Intensity calculations are performed using a ^^ot P^odort 
teSTen the surface nLal or normals and the illumination source to implement « ^ambertian dtiusefy 

is fnhSrdTorp^ y^^^^^^ appear in the same image as multiple vertex polygons or may comprise ^e 

te^TZTl GAP c».p,is« a La «g«a, » « m . J« ^ • 

coellident .esisM. «te me^rv 206. a noaling point a»;u™law 206. a 200 Mte oscillaB. 210. 

denser By using the known relationship between distance and tog density, the fog "^''i'^^ss can oe 
"diS- oJ adK^sted as needed. The vertex assignment interpolates the vertex color toward the fog color as 

assianed by elevation banding or monochrome delault value, ine Tog coior li wu 
enginel4 explained in more detail below, then straight fon^ardly Interpolates the .ntenor pants. 

in another alternative embodiment of the invention, a DaVinci effect is implemented Tj^ Of^irK. 
causes rTerrain to fade into the distance and blend with the horizon. It is implemented as a func^on^ 
5 a^e 0 the p^^^^^^ vertices by the GAP. The horizon color is added to the vertices similarly to the fog 



effect. 

SHAPE ADDRESS GENERATOR (SHAG) 
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The SHAG 12 receives the oilhographically projected view volume outline onto cache from the DSM. It 
calculates the individual line lengths of the scans and the delta x and delta y components. It also scans the 
elevation posts out of the elevation cache memory and passes them to the QAPs for transformation. In one 
embodiment of the invention, the SHAG preferably includes two arithmetic logic units (ALUs) to support the 

6 50 nsec cache 10. In the SHAG, data is generated for the GAPs and control signals are passed to the tiling 
engine 40. DFAD data is downloaded into overlay RAM (not shown) and three dimensional symbols are 
passed to the GAPs from symbol generator 38. Elevation color banding hue assignment is performed in this 
function. The SHAG generates shapes for plan view, perspective view, intervisibility, and radar simulation. 
These are illustrated in Figure 7. The SHAG is more fully explained in EP-A2-0 345 672. 

70 A simple Lambertian lighting diffusion model has proved adequate for generating depth cueing in one 
embodiment of the invention. The sun angle position is completely programmable in azimuth and zenith. It 
may also be self-positioning based on time of day, time of year, latitude and longitude. A programmable 
intensity with gray scale instead of color implements the moon angle position algorithm. The display stream 
manager (DSfVI) programs the sun angle registers. The illumination intensities of the moon angle position 

76 may be varied with the lunar waxing and waning cycles. 

TILING ENGINE AND TEXTURE ENGINE 

Still referring to Figures 4 and 5, the moans for calculating texture vertex address 18 may include the 

20 tiling engine 40. Elevation posts are vertices of planar triangles modeling the surface of the terrain. These 
posts are "tagged" with the corresponding U.V coordinate address calculated in texture space. This tagging 
eliminates the need for interpolation by substituting an address lookup. Referring to Figures lOA. lOB, IOC 
and 10D. with continuing reference to Figures 4 and 5. the tagged architectural texture mapping as 
employed by the invention is illustrated. Figure 10A shows an example of DTED data posts, DP. in world 

25 space. Rgure 10B shows the co-located texture space for the data posts. Figure IOC shows the data posts 
and rendered polygon in screen space. Rgure 10D illustrates conceptually the interpolation of tagged 
addresses into a rendered polygon RP. The texture engine 30 performs the tagged data structure 
management and filtering processes. When the triangles are passed to the rendering engine by the tiling 
engine for filling with texture, the tagged texture address from the elevation post is used to generate the 

30 texture memory address. The texture value is filtered by filtering and interpolation means 26 before being 
written to full-frame memory 22 prior to display. 

The tiling engine generates the planar polygons from the transformed vertices in screen coordinates 
and passes them to the rendering engine. For terrain polygons, a connectivity offset from one line scan to 
the next is used to configure the polygons. For overlay symtxDts. a connectivity list is resident in a buffer 

35 memory (not shown) and is utilized for polygon generation. The tiling engine also informs the GAP If it is 
busy. In one embodiment 512 vertices are resident in a IK buffer. All polygons having surface normals 
more than 90 degrees from LOS are eliminated from rendering. This is known in the art as backface 
removal. Such polygons do not have to be transformed since they will not be visible on the display screen. 
Additional connectivity information must be generated if the polygons are non-planar as the transformation 

■40 process generates implied edges. This requires that the connectivity information be dynamically generated. 
Thus, only planar polygons with less than 513 vertices are implemented. Non-planar polygons and dynamic 
connectivity algorithms are not implemented by the tiling engine. 

RENDERING ENGINE 

45 

Referring again to Figure 5. the rendering engine 34 of the invention provides a means of drawing 
polygons in a plurality of modes. The rendering engine features may include interpolation algorithms for 
processing coordinates and color, hidden surface removal, contour lines, aircraft relative color bands, flat 
shading. Gouraud shading, phong shading, mesh format or screen door effects, ridgeline display, transverse 

50 slice, backface removal and RECE (aerial reconnaissance) photo modes. With most known methods of 
image synthesis, the image is generated by breaking the surfaces of the object into polygons, calculating 
the color and intensity at each vertex of the polygon, and drawing the results into a frame buffer while 
interpolating the colors across the polygon. The color information at the vertices is calculated from light 
source data, surface normal, elevation and/or cultural features. 

55 The interpolation of coordinate and color (or intensity) across each polygon must be performed quickly 
and accurately. This is accomplished by interpolating the coordinate and color at each quantized point or 
pixel on the edges of the polygon and subsequently interpolating from edge to edge to generate the fill 
lines. For hidden surface removal, such as is provided by a Z-buffer in a well-known manner, the depth or 
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HaMvo rolor bands. For these features the elevation also is "^^^'^^^ J j-ese requirements imply 
lis dictate that an alpha channel be — J^^^^^^^^^ 

ro;"err^^^^^ - *° - -^'^^^ 

trranUn, m^e the rendering enoine assig. - -S^Jt%nt ^nVhS" 
surface. An arbitrary vertex ^ se^cje^ to as.g J^o^^;-;^^^ ' ^^^^^^^^ , performed r>ormally bu, 
Sralo'nLrr. Vrroi' :;™d up .e render-na process but wi,l peHorm the 

'^TC:^SX^ included -n -J,™^ 

the vertices of each polygon rendered in a '^^J^^^^ ^the pigon between applying the 

algorithm interpolates the surface ""'-^.^'^ ^^^^^^l^^^^^^^ 

intensity calculations. The rendermg «"9'"^,;°."'^. ''7' design. This algorithm may 
20 pixel after interpolation. This approach -'^"'^^'^"'SSv fu^^^^^^^ of co^ne ()) around a narrow band of 
Se simulated, however, using a weighing ♦""^^•^"i^*^'^^^"^^^;"/^^^^^^^ provides for a simulated specular 
the intensities. This results in a non-lmear ^^'^^'^^Xl^Z.oZ^^ Xl.e vertices of the polygon this 
reflectance. In an alternative embodiment. ^J^^^'^^J^J^f "^^^^^ as in Gouraud shading, 

non-linear weighing via the look-up table and the ^^^"^^^""9 .^"^'^^.^^^^^^ or may be simulated with a 
,s Transparency is implemented in the classical ^^"f? ^" ^^^^^^ as normal but then only 

screen door effect. The screen door effect sim^y '^I^f ^^^^^ overlay with the option of 

outputs every other or every third P''*^' J';f J^^^^^^^^^^^ symbol, all polygon edges must 

rendering either hidden lines rernoved or not _ In '^^^ '''J^Z fill algorrthm of the rendering engine is 

«''^Typicaloftheheadsupdis,ay(HUD)format^jd^^^ 

OS slice, m the ridgeline format. '^mSl^ "^^-"^'^ 

relative to the viewpoint. All polygons are 'j^rtices of non-ridge contributing edges 

and compared to the viewpoint. The ''''"9 ^J^^^^f^^ ^ t^ slice m'ode. fixed range bins 

and passes only the ridge polygons o *^;^^™9 ^^^^^^^ -.sthen passed through for rendering, 

relative to the aircraft are defined. A plane °rtt^°"il° ^Jf^'T;.,^" ^lo' jhese algorithms are similar to 

^ The ridges then appear to roll over the terrain ^J^^^^^^ j'^Sd to the tinng engine. 

backface removal. They rely upon the PO'vaon ^"^^^^^"^L^/' ^^"l^ecting polygon sides by restricting 
one current implementation of the invention 9"/^ also consist of one 

the polygons rendered to be P-an- They may J^- J^^,^^^^^^^^^ the rendering engine. The 

or two vertices. The polygon "end bit is set at the f^'T^'''^^^^ or Gouraud shading. The 

« polygon is tagged with a two bit rendering c^^^^ fcfet fo'l^e po"^^^^^^ a^d implements a smoothing 
rendering engine also accomplishes a fine clip to the screen Torm p ya 

function for lines. „ ^ qaP to texture map an aerial 

An optional aerial Tthis mode the hue interpolation of the rendenng 

reconnaissance photograph onto the DTED data t^s®. " x ^ intensity 

engine is inhibited as each pixel of the warping is ^^^^"f J ^"^^^^^^^^^ s^rfaoa ndm^al as well as 

component of the color is dithered in « -"^^ ^^^^^^^ ^^^^^ zUer rectification so that other 
the Z-depth. These pixels are then processed by the rende^^^^^ ^^.^ ^^^^ 

overiays such as threats may be ^^^^ I"" "f^^^^^^ 

previously warped onto a tessellated gead data basej^^ *uj ^^J^^^^™ J^his implies a deeper 
as described in US-A-4 899 293. The P>^°t°^ ^J^^^^^ mSTis identical to RECE photos 

cache memory to ^^^^^J^f^'^lZZ^^^^^^^^ '^^^ « ^^^^ " 

except that aeronautical charts are usea m uw 

elevation color band aeronautical charts. 
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The polygon- rendering engine may preferably be implemented in a generic interpolation pipeline 
processor (GIPP) of the type as disclosed in EP-A2-0 382 139. In one embodiment of the invention, the 
GIPPs fill in the transformed polygons using a bi-linear interpolation scheme with six axes (X,Y,Z,R.G,B). 
The primitive will interpolate a 16 bit pair and 8 bit pair of values simultaneously, thus requiring 3 chips for 

5 a polygon edge. One emtwdiment of the system of the invention has been sized to process one million 
pixels each frame time. This is sufficient to produce a IK x IK high resolution chart, or a 512 x 512 DTED 
frame with an average of four overwrites per pixel during hidden surface removal with GIPPs outputting data 
at a 60 nsec rate, each FIFO, F1-F4. as shown in Rgure 6. will receive data on the average of every 240 
nsec. An even distribution can be assumed by decoding on the lower 2X address bits. Thus, the memory is 

10 divided into one pixel wide columns. Figure 6 is discussed in more detail below. 

Referring again to Figures 4 and 5, the "dots" are passed through the GIPPs without further processing. 
Thus, the end of each polygon's bit is set. A 2B buffer is needed to change the color of a dot at a given 
pixel for hidden dot removal. Perspective depth cuing is obtained as the dots get closer together as the 
range from the viewpoint increases. 

IS Bi-linear interpolation mode operates in plan view on either DLMS or aeronautical charts. It achieves 20 
H2 interpolation on a 512 x 512 display. The GIPPs perform the interpolation function. 

DATA BASES 

20 A Level I DTED data base is included in one embodiment of the invention and is advantageously 
sampled on three arc second intervals. Buffer segments are preferably stored at the highest scales (104.24 
nm) and the densest data (13.03 nm). With such a scheme, all other scales can be created. A Level II 
DTED data base is also included and is sampled at one arc second intervals. Buffer segments are 
preferably stored only at the densest data (5.21 nm). 

25 A DFAD cultural feature data base is stored in a display list of 2K words for each buffer segment. The 
data structure consists of an icon font call, a location in cache, and transformation coefficients from model 
space to world space consisting of scaling, rotation, and position (translation). A second data structure 
comprises a list of polygon vertices in world coordinates and a color or texture. The DFAD data may also 
be rasterized and overlaid on a terrain similar to aerial reconnaissance photos. 

30 Aeronautical charts at the various scales are warped into the tessellated geoid. This data is 24 bits 
deep. Pixel data such as LandSat, FLIP, data frames and other scanned in source data may range from one 
bit up to 24 bits in powers of two (1 .2,4.8.16.24). 

FRAME BUFFER CONFIGURATION 

35 

Referring again to Rgure 6, the frame buffer configuration of one embodiment of the invention is shown 
schematically. The frame buffer configuration is implemented by one embodiment of the invention 
comprises a polygon rendering chip 34 which supplies data to full-frame memory 42. The full-frame 
memory 42 advantageously includes first-in, first-out buffers (FIFO) Fi. F2. F3 and F4. As indicated above 

40 with respect to the discussion of the rendering engine, the memory is divided up into one pixel wide 
columns as shown in Figure 6. By doing so. however, chip select must changed on every pixel when the 
master timer 44 shown in Rgure 5 reads the memory. However, by orienting the SHAG scan lines at 90 
degrees to the master timer scan tines, the chip select will change on every line. The SHAG starts scanning 
at the bottom left corner of the display and proceeds to the upper left corner of the display. 

45 With the image broken up in this way. the probability that the GIPP will write to the same FIFO two 
times in a row, three times, four, and so on can be calculated to determine how deep the FIFO must be. 
Decoding on the lower order address bits means that the only time the rendering engine will write to the 
same FIFO twice in a row is when a new scan line is started. At four deep as shown in the frame buffer 
graph 100. the chances of the FIFO filling up are approximately one in 6.4K, With an image of 1 million 

60 pixels, this will occur an acceptably small number of times for most applications. The perspective view 
transformations for 10,000 polygons with the power and board area constraints that are Imposed by an 
avionics environment is significant. The data throughput for a given scene complexity can be achieved by 
adding more pipeline in parallel to the architecture. It is desirable to have as few pipelines as possible, 
preferably one. so that the image reconstruction at the end of the pipeline does not suffer from an 

55 arbitration bottleneck for a 2-buffered display memory. 

In one embodiment of the invention, the processing throughput required has been achieved through the 
use of GaAs VSLI technology for parallel pipelines and a parallel frame buffer design has eliminated 
contention bottlenecks. A modular architecture allows for additional functions to be added to further the 
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flexibility while maintaining speed and data throughput, ine poiygoridi u 

accommodate arbitrary scene c-plexity and a di^^^^^^^ Xo"" ay t>e rendered via any of the 

The data structure of the invention is tagged so that any poiygo" nwy ^^oH^ terrain 

and would require a 32K by 8 RGB RAM look-up table (LUT). 

70 

MISCELLANEOUS FEATURES 

Z-buffer is 16 bits. This allows 64K meters down range^^ ^ programmable and 

perspective view. The GPP 105 loads the countdown ^^^^'T.J"^^^^^^^^^ J^ories will 

The slowest update rate is 8.57 Hz. The .mage ^^^^^ ^^"^^^^"s 5^^^ « is estimated 
switch. This implies a pipeline speed of 40 m.lhon pixels per ^^^^^^'^J^^'J^^^^^^ ,„ ^st cases, 

that there would be 4 million pixels rendered -l%^^;;^.^^XToi ^ToveZl The minimum 

calculated on the fly in accordance with known techniques. 
DISPLAY MEMORY 

™. « . a ocn.«™a..„ o, sc.™ and -»,^™J,!rrt:rr'°a^ 
c^„a, ^ d^ng »^ an. <^^'^^,^J'"^j:^X^^ x ..2 x « o, 
requiraa is approximalely 50 MH2. ^'^'''fl™^.^, Al me Stan o( each mala cycle. 

set by the DSIVI over the control bus. backaround color. In certain modes 

configuration bus and used to fill in the memory. 

65 

VIDEO GENERATOR/MASTER TIMER 

The video generator 46 performs the digital to analog conversion of the image data in the display 



25 



30 



40 



45 



iN'SOOCID: <EP 0454129A2J_> 




EP 0 454 129 A2 



memory -to send to the display head. It comlDines the data stream from the overlay memory of the DMC 
with the display memory from the perspective view. The configuration bus loads the color map. 

A 30 Hz interlaced refresh rate may be implemented in a system employing the present invention. 
Color pallets are loadable by the GPP. The invention assumes a linear color space in RGB. All colors at 
5 zero intensity go to black. 

THREE DIMENSIONAL SYMBOL GENERATOR 

The three-dimensional symbol generator 38 performs the following tasks: 
70 1. It places the model to world transformation coefficients in the GAP. 

2. It operates in cooperation with the geometry engine to multiply the world to screen transformation 
matrix by the model to world transformation matrix to form a model to screen transformation matrix. This 
matrix is stored over the model to world transformation matrix. 

3. It operates in cooperation with the model to screen transformation matrix to each point of the symbol 
15 from the vertex list to transform the generic icon to the particular symbol. 

4. It processes the connectivity list in the tiling engine and forms the screen polygons and passes them 
to the rendering engine. 

The symbol generator data base consists of vertex list library and 64K bytes of overlay RAM and a 
connectivity list. Up to 18K bytes of DFAD (i.e.. 2K bytes display list from cache shadow RAM x 9 buffer 

20 segments) are loaded into the overlay RAM for cultural feature processing. The rest of the memory holds 
the threat/intelligence file and the mission planning file for the entire gaming area The overlay RAM is 
loaded over the control bus from the DSM processor with the threat and mission planning files. The SHAG 
loads the DFAD files. The symbol libraries are updated via the configuration bus. 

The vertex list contains the relative vertex positions of the generic library icons. In addition, it contains a 

25 16 bit surface normal, a one bit end of polygon flag, and a one bit end of symbol flag. The table is 32K x 16 
bits. A maximum of 512 vertices may be associated with any given icon. The connectivity list contains the 
connectivity information of the vertices of the symbol. A 64K by 12 bit table holds this information. 

A pathway in the sky format may be implemented in this system. It consists of either a wire frame 
tunnel or an elevated roadbed for flight path purposes. The wire frame tunnel is a series of connected 

30 transparent rectangles generated by the tiling engine of which only the edges are visible (wire mesh). 
Alternatively, the polygons may be precomputed in world coordinates and stored in a mission planning file. 
The roadbed is similarly comprised of polygons generated by the tiler along a designated pathway. In either 
case, the geometry engine must transform these polygons from object space (world coordinate system) to 
screen space. The transformed vertices are then passed to the rendering engine. The parameters (height. 

35 width, frequency) of the tunnel and roadbed polygons are programmable. 

Another symbol used in the system is a waypoint flag. Waypoint flags are markers consisting of a 
transparent or opaque triangle on a vertical staff rendered in perspective. The waypoint flag icon is 
generated by the symbol generator as a macro from a mission planning file. AHematively. they may be 
precomputed as polygons and stored. The geometry engine receives the vertices from the symbol 

40 generator and performs the perspective transformation on them. The geometry engine passes the rendering 
engine the polygons of the flag staff and the scaled font call of the alphanumeric symbol. Plan view format 
consists of a circle with a number inside and is not passed through the geometry engine. 

DFAD data processing consists of a generalized polygon renderer which maps 32K points possible 
down to 256 polygons or less for a given buffer segment. These polygons are then passed to the rendering 

45 engine. This approach may redundantly render terrain and DFAD for the same pixels but easily accom- 
modates declutter of individual features. Another approach is to rasterize the DFAD and use a texture warp 
function to color the terrain. This would not permit declutter of individual features but only classes (by 
color). Terrain color show-through in sparse overiay areas would be handled by a transparent color code 
(SCTeen door effect). No verticalrty is achieved. 

50 There are 298 categories of aerial, linear, and point features. Linear features must be expanded to a 
double line to prevent interlace strobing. A point feature contains a length, width, and height which can be 
used by the symbol generator for expansion. A typical lake contains 900 vertices and produces 10 to 20 
active edges for rendering at any given scan line. The number of vertices is limited to 512. The display list 
is 64K bytes for a 1:250K buffer segment. Any given feature could have 32K vertices. 

55 Up to 2K bytes of display list per buffer segment DTED is accommodated for DFAD. The DSM can tag 
the classes or individual features for clutter/declutter by toggling bits in the overlay RAM of the SHAG. 

The symbol generator processes macros and graphic primitives which are passed to the rendering 
engine. These primitives include lines, arcs, alphanumerics. and two dimensional symbology. The rendering 

10 
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enqine draws these primitives and outputs pixels which are anti-aliased. The GAP transforms these 
p^rgons and passes them to the rendering engine. A complete 4x4 Euler »'anstom«.on .s perform^^^ 
Vypical macros incl.de compass rose and range scale symbols. Given a macro command the symbol 
geSator produces the primitive graphics calls to the rendering engine. This mode operates m plan v,ew 
5 0 y Td implements J dimensional symbols. Those skilled in the art will appreciate that the mvent.on .s 
not limited to specific fonts. Three dimensional symbology presents the problem of d.pp.ng to the v^ew 
Volume. A gross clip is handled by the OSM in the cache memory at scan out t.me The base o a thre 
dome, for example, may lie outside the orthographic projection of the view volume onto cache yet a part of 
its dome may end up visible on the screen. The classical implementation perfomis the functions of fling. 
,0 transforming, clipping to the view volume (which generates new polygons), and then rendenng. A gross chp 
boundary is implemented in cache around the view volume projection to guarantee ^^^'^'^^J''^^''^^. 
symbol. The anomaly under animation to be avoided is that of having symbology sporadically appearand 
dLppear in and out of the frame at the frame boundaries. A fine clip to »J« '^^ P« J° ^^^^^^ 

dowSream by the rendering engine. There is a 4K boundary arourvi the screen which J.^^^^^^^ 
,5 of this boundary, the symbol will not be rendered. This causes extra rendering which is clipped away. 
Threat domes are represented graphically in one embodiment by an inverted ~n,c jl 
threatAintelligence file contains the location and scaling factors for the generic model to be transformed to 
he specific threats. The tiling engine contains the connectivity information between Je vertices and 
generis the planar polygons. The threat polygons are passed to the rendering engine with vanous viewing 
20 parameters such as mesh, opaque, dot. transparent, and so forth. . ^ ^. ^ ^ 

Graticles represent latitude and longitude lines. UTM klicks. and so forth which are warped onto the 

map in perspective. The symbol generator produces these lines. 

Freeze frame is implemented in plan view only. The cursor is flown around the screen, and is generated 

''Trogrm'lrS capability is accommodated in the invention. The DSM updates the overlay RAM 
tooQle for display The processor clock is used during variable frame update rate to control the blink rate. 

''a Sneric ?h eat symbol is modeled and stored in the three dimensional symbol Q^neraton library^ 
Parame'te" such as position, threat range, and angular threat view are Passed to tfie sym^^^^ ^ZtZl 
macro call (similar to a compass rose). The symbol generator creates a polygon list for each threat instance 
rusing hHararneters to modify L generic model and place it in the world coordinate system of the 
terrrdate base. The polygons ^e transformed and rendered into screen space by the perspective view 
pipeline. These polygons form only the outside envelope of the threat cone. 
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System for providing a texture mapped perspective view of a plurality of polygons tor a digital map 
system characterized by: 

(a) means for storing elevation data (10) for each polygon; 

(b) means for storing texture date (24) for each polygon; .,.'»,„rf„„ 

c means for scanning a projected view volume (12) coupled to the elevation data s °nng means 
S means for processing (14) including means for receiving the ^""^^ . P^^'^^J^^"^^^^^^ 
rom the scanning means, means for transtom^ing the scanned projected view -o^-^^ J^"' "^ject 
sp^ce to screen space (22) and means for computing surface normals at each vertex of each 
DolvQon so as to project elevation posts; . , r*. ^* r^i^r.or 

S tLg engine means (40) coupled to the processing means for generatng a plurality of planar 

polygons from the transfonned vertices; =HrtrB«<!(X! m 

5i a texture engine means (30) for tagging the elevation posts wrth corresponding addresses in 

irmea^SJi'lpled to the tiling engine means (40) and texture engine means (30) for rendering 
images from the planar polygons by shading between the tagged vertices of each polygon. 

A system for providing a texture mapped perspective view for a digital map system characterized by: 

(a) a cache memory (10) for storing terrain data; .u„^,wnian 

(b) a shape address generator (12) for scanning cache memory (10) and generating shapes for plan 
view, perspective view, intervisibility and radar simulation; 

(c) a geometry engine (36) coupled to the cache memory (10) for. 

(i) transformation of terrain data from object space to screen space, 
(il) generating three dimensional coordinates, and 
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(Hi) computing surface normals at each vertex of the polygons 

(d) a tiling engine (40) coupled to the geometry engine (36) for generating the planar polygons from 
the transformed vertices In screen coordinates and passing them to the rendering engine (34); 

(e) a symbol generator (38) coupled to the geometry engine (36) and the tiling engine (40) for 
transmitting data to the geometry engine (36) and processing Information from the tiling engine (40) 
into symbols; 

(f) a texture engine (30) for tagging elevation posts with corresponding addresses In texture space; 

(g) a rendering engine (34) coupled to the tiling engine (40) and the texture engine (30) for 
generating Images from the planar polygons; and 

(h) a display memory (42) coupled to the rendering engine (34). 

3. System according to Claim 2 characterized in that the display memory (42) Includes at least four 
first-in, first-out memory buffers (F1 to F4). 

4. System according to Claim 1 or 2 characterized in that the rendering engine (34) is comprised of a 
plurality of generic parallel pipeline processors. 

5. System according to Claim 1 or 2 characterized in that the rendering means (30) assigns one color 
across the surface of each polygon. 

6. System according to Claim 1 or 2 characterized in that the rendering means (30) interpolates the 
intensities between the vertices of each polygon in a linear fashion, 

7. System according to Claim 1 or 2 characterized in that the rendering means (30) further includes 
means for providing transparency. 

8. System according to Claim 2 further characterized by a video display means (46) coupled to the 
display memory (42). 

9. System according to Claim 1 or 2 further characterized by a full frame memory means (100) for 
storing display data coupled to the rendering means. 

10. System according to Claim 9 further characterized by a video display means (46) coupled to the full 
frame memory (100) means wherein the video display means (46) includes switchable display formats 
being switchable at less than 600 milliseconds between paper chart, DLMS plan and perspective view. 
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Fig.- 6 
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0 System for generating a texture mapped perspective view. 
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0 A method and apparatus for providing a texture 
mapped perspective view for digital map systems. 
The system includes apparatus for storing elevation 
data (10), apparatus for storing texture data (24), 
apparatus for scanning a projected view volume (12) 
from the elevation data storing apparatus, apparatus 
for processing (14), apparatus for generating a plu- 
rality of planar polygons (1 6) and apparatus for ren - 
dering images. The processing apparatus further 
includes apparatus for receiving the scanned pro- 
jected view volume from the scanning apparatus, 
transforming the scanned projected view volume 
from object space to screen space, and computing 
surface normals at each vertex of each polygon so 
as to modulate texture space pixel intensity. The 
generating apparatus generates the plurality of 
planar polygons from the transformed vertices and 
supplies them to the rendering apparatus which then 
shades each of the planar polygons. In one alternate 
embodiment of the invention, the polygons are 
shaded by apparatus of the rendering apparatus 
assigning one color across the surface of each 
polygon. In yet another alternate embodiment of the 
invention, the rendering apparatus interpolates the 



intensities between the vertices of each polygon in a 
linear fashion as in Gouraud shading. 
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